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(54) Motion compensated video signal processing 

(57) Video signal processing apparatus for interpolating output images of an output video signal from corresponding pairs of 
temporally adjacent input images of an input video signal is described. The apparatus comprises a motion vector generator 
for generating sets of motion vectors representing motion between respective pairs of temporally adjacent input images; an 
analyzer 70 for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of 
the degree of correlation between the pair of temporally adjacent input images from which that set of motion vectors was , 
generated and for detecting a change of at least a predetermined size in the test results obtained for successive sets of 
motion vectors, thereby indicating a possible scene change in the input video signal; and a motion compensated interpolator 
99 for interpolating an output image from a corresponding pair of temporally adjacent input images using the sets of motion 
vectors generated from that pair of input images when a possible scene change is not indicated, and for generating an 
output image by intra-image processing of one of the corresponding pair of input images when a possible scene change is 

indicated. 70 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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2263602 

1 

MOTION COMPENSATED VIDEO SIGNAL PROCESSING 

This invention relates to the field of motion compensated video 
signal processing. 

5 Motion compensated video signal processing is used in video 

processing applications such as television standards conversion or 
video to film conversion. An example of a previously proposed motion 
compensated video processing apparatus is described in the British 
Published Patent Application number GB-A-2 231 7^9 . in which pairs of 

10 temporally adjacent images (fields or frames) of an input digital video 

signal are processed to generate corresponding sets of motion vectors. 
The processing is carried out on discrete blocks of the images, so that 
each motion vector represents the inter-image motion of the contents of 
a respective block. After further processing, the set of motion 

15 vectors is supplied to a motion compensated interpolator which 

interpolates an output image from the pair of input images, taking into 
account the motion between the input images, 

A problem with this previously proposed apparatus, and which 
occurs generally in motion compensated video signal processing, is that 

20 in order to drive the signal processing accurately, the information 

generated about the motion of objects in the image (ie the set of 
motion vectors) must itself be accurate. A particular difficulty is 
that scene changes, and indeed cuts, wipes, fades and some other 
effects, can appear to the motion vector estimator as rapid random 

25 changes in motion. Also, an output image interpolated across a scene 

change can contain parts of two unrelated images. This can cause 
unpleasant artifacts in the output images, which may be even more 
noticeable if any post-processing is applied to the video signal. 

This invention provides a video signal processing apparatus for 

30 interpolating output images of an output video signal from 

corresponding pairs of temporally adjacent input images of an input 
video signal, the video signal processing apparatus comprising: 

a motion vector generator for generating sets of motion vectors 
representing motion between respective pairs of temporally adjacent 

35 input images; 

an analyzer for performing a predetermined test for each set of 
motion vectors to obtain a respective test result indicative of the 
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advantageous as appropriate action (changing to intra-frame generation 
of that output image) can be taken. 

If a scene change occurs between two temporally adjacent input 
images from which neither a set of motion vectors nor an output image 
is calculated then that scene change would not be detected by the 
analyzer. However, that scene change would have no effect whatsoever 
on the operation of the interpolator, so the fact that it goes 
undetected is immaterial. 

Preferably the motion compensated interpolator comprises: means 
for receiving a control signal indicative of the temporal position of 
an output image to be interpolated with respect to the temporal 
positions of the corresponding pair of temporally adjacent input 
images; means responsive to the control signal for setting the relative 
proportions of the corresponding pair of input images to be used in 
interpolation of the output image in dependence on the temporal 
position of the output image when a possible scene change is not 
indicated; means for setting the relative proportions of the 
corresponding pair of input images to be used in interpolation of the 
output image so that the output image depends on the content of a 
selected one of the pair of input images when a possible scene change 
is indicated; and interpolation means for generating the output image 
by combining the corresponding pair of input images according to the 
relative proportions. 

The selected one of the input images could be predetermined, but 
preferably the selected one of the pair of input images is the input 
image which is temporally closest to the output image. 

Since the set of motion vectors generated at a scene change can 
be meaningless it is preferred that the motion compensated interpolator 
comprises means for setting the set of motion vectors to be used in 
interpolation to a set of zero motion vectors when a possible scene 

change is indicated. 

An alternative to using a modified interpolator is to employ an 
image store for storing at least one of the corresponding pair of input 
images from which an output image is to be interpolated; and means 
responsive to the analyzer indicating a possible scene change for 
setting the output image to be equal to at least a portion of a stored 
input image. 



In one preferred en.bodin.ent the motion vector ffen . * 

^ PGrf0rming a — er ffli „ed ccaftj^t^^ 
vector in a set of motion vectors- m h ,k eaCh m ° tion 

~ ing . test resuit depe - * _ 

vectors, in a set of motion vector. k- k Pr ° P ° rtlon of the motion 

occurring motion vectors in a set of „„ ' c °°" lonl y 

co. p ri S es means for generating a , , ^""^ "* <"* 

the fluencies of ^JTl °°°° «" ~ "* 

commonly occurring motion vectors —» * «* 

The invention is particularly suited for „«, • 
Che input images are successive video ^ of " 8 ^ " "** 
However, since tne actual video signal suTpli d »£T 
in interlaced form, it is preferred to .T„, ™>y be 

interlaced video signal and a prXsive Z *" ™ n * °* 

P-rs of temporally adjacent ^T^.TIT^ 
^.respective video frames of ^C^ZT "~ 

— .^isrrr-" 1 - — ^ - - 

— according to any -JZ^ZZSZT 

^terpolX^ ™ ~ ' — - 

^responding pairs of ^ Z^Zj^ft ^ 
video signal th<=. mor K„j . images of an input 

gnaJ.. the method comprising the steps of- 

generating sets of ' motion ve^nrc „ 
elective pairs of temporally Z^Z^T — 

het„een tnat p air of temporally ^TC^T " ™» 

ceuits 8 ^; riiirrr te r d * in - - 

-eating a ib le scene c h ange 1^7^X1' ^ 

interpolating an output imaire from 
temporally adjacent in»„, corresponding pair of 

generated frol rt ^r 10 ^ 8 ^ ^ ° f ™ 

- not ^ r^^^'^---*-* 

generating an output image by intra-image 



processing of one of the corresponding psir of input i»ages when e 
possible scene change is indicated. 

' Events of the invention will now be described by way of 
example only with reference to the accompanying drawings throughout 
which like parts are referred to by like references, and in which: 

Figure 1 is a block diagram of a previously proposed motion 
compensated television standards conversion apparatus; 

Figure 2 is a schematic diagram showing the operation of the 

apparatus of Figure 1; 

Figure 3 is a schematic diagram showing the operation of the 

interpolator in Figure 1; 

Figure 4 shows one embodiment of an analyzer for detecting 

possible scene changes in an input video signal; 

Figure 5 shows another embodiment of an analyzer for detecting 
possible scene changes in an input video signal; 

Figure 6 shows a modified interpolator for performing mtra-frame 
generation of an output image when a possible scene change is detected; 

Figures 7 and 8 are schematic diagrams illustrating the operation 
of the interpolator of Figure 6; and 

Figures 9 and 10 show alternative modifications to the apparatus 
of Figure 1 for performing intra-frame generation of an output image 
when a possible scene change is detected. 

Referring now to Figure 1. a block diagram of a previously 
proP osed motion compensated television standards conversion apparatus 
for converting an input interlaced high definition video signal (HDVS 
8 having 1125 lines per frame and 60 fields per second into an output 
interlaced video signal 40 having 62 5 lines per frame and 5 0 fields per 
second is shown. The input video signal 8 is first supplied to a 
progressive scan converter 10 in which the input video fields are 
converted into video frames at the same rate (60 Hz) as the input video 
fields. These frames are then supplied to a down converter 12 which 
reduces the number of lines in each of the frames to 62 5 . the number of 
lines in a frame of the output video signal 40. The down-converted 
input frames are then passed to a time base changer lH which also 
receives as inputs a 60Hz clocking signal 32 locked to the field 
frequency of the input video signal 8 and a 5 0Hz clocking signal 3* 
locked to the required field frequency of the output video signal 40. 



of the ^ d " ermlneS ^ te " P °™ 1 of each field 

of he output vl deo signal end selects two of the down-converted frames 
of the input video signal 8 to he used in interpolating that field " 
the output video signal. The two down-converted input frames selected 

th.rd output 18 of the time hese changer carrying control inhabit, 
The vxdeo signals corresponding to the two down-converted input 

frames selected by the time base changer 1H are s ™, (rf . 

a motion processor 20 Th„ ! ■ '"M*"* as inputs to 

,n >. motlcn Pressor comprises two 

10 substantially identical processing sections: one for even output field7 

aad one for odd output fields. The two down-converted input fr^ 

the odd f le ld processing section as appropriate by means of a switch 21 
under the control of a signal (not shown, derived from the 5 0 Hz 
15 clocking signal 3*K D z 

20 6 aPPr ° Priate S6Cti0n (odd or — ) of the motion pressor 

20. the down-converted input frames are supplied first to a direct 
block matcher 22 which calculates correlation surfaces representing the 
spatial correlation between blocks of the two frames. These 
correlation surfaces are passed to a motion vector estimator 24 which 
Processes the correlation surfaces to generate a set of motion vectors 
which are supplied to a motion vector reducer 26. motion vectop 

estimator also performs a confidence test on each generated motion 
vector to establish whether that motion vector is significant above the 

vecto -T Se l6Ve1, aSS ° CiateS S ^ each motion 

ec tor mdicatxve of the result of the confidence test. The confidence 
test itself comprises a 'threshold test' and a 'rings test' and is 
described, along with other features of the apparatus shown in Figure 

so ce-i-v;; 6 7 t; ail in the British Published Patent Appiicati ° n — 

11» motion vector reducer 26 operates to reduce the choice of 
Possible motion vectors for each pixel in each block, before the motion 
vectors are supplied to a motion vector selector 28. As part of its 
function the motion vector reducer 26 counts the frequencies of 
occurrence of the 'good' motion vectors (ie motion vectors which passed 
the confidence test), with no account taken of the position of the 
blocks of the input images used to obtain those motion vectors. The 
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good motion vectors are then ranked in order of decreasing frequency. 
The three most common of the good motion vectors which are 
significantly different to one another are then classed as 'global' 
motion vectors. Three motion vectors which passed the confidence test 
are then selected for each block and are supplied, with the zero motion 
vector, to the motion vector selector 28 for further processing. These 
three selected motion vectors are selected in a predetermined order of 
preference from the motion vector generated from that block, those 
generated from the surrounding blocks, and finally the global motion 
vectors . 

The motion vector selector 28 also receives as inputs the two 
down-converted input frames selected by the time base changer 14 and 
which were used to calculate the motion vectors (suitably delayed by a 
system delay compensator 30) and supplies an output comprising one 
motion vector per pixel of the output field. This motion vector is 
selected from the four motion vectors for that block supplied by the 
motion vector reducer 26. Any irregularity in the selection of the 
motion vectors by the motion vector selector 28 is removed by a motion 
vector post processor 36, from which the processed motion vectors are 
supplied to and control an interpolator 38 which also receives the 
appropriate odd or even pair of down-converted input frames selected by 
the time base changer, again suitably delayed by the system delay 
compensator 30. Using the motion vectors, the interpolator 38 
interpolates an output field from the two down-converted input frames 
selected by the time base changer, taking into account any image motion 
between the two frames. The two down-converted input frames are 
combined in relative proportions depending on the temporal position of 
the output field with respect to the two frames, so that a larger 
proportion of the nearer input image is used. The output *»0 of the 
interpolator 38 is an interlaced video signal having 625 lines per 
frame and 50 fields per second. 

Figure 2 illustrates the way in which pairs of temporally 
adjacent down-converted frames of the input video signal 8 are selected 
by the time base changer 1*1 for use in interpolating a corresponding 
odd or even field of the output video signal *»0. The upper row in 
Figure 2 represents the down- converted frames of the input video signal 
8. As mentioned above, the input video signal has a field rate of 60Hz 
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temporal displacement of the output field 50 from the following input 
frame 5^- A filtering process is used so that the portions 60 and 62 
on which the pixel 56 depends comprises a group of pixels in the 
respective input frame 52, 5^» 

The interpolation process described above relies on the 
assumption that the portion 60 t the pixel 56, and the portion 62 all 
relate to the same part of an image, even though that part has moved 
between the preceding input frame 52 and the following input frame 54. 
This assumption can fail for two reasons when a scene change or another 
dynamic video effect occurs between the preceding input frame 52 and 
the following input frame 5^- 

One reason that the motion compensated interpolation process 
shown in Figure 3 may fall down at a scene change is that the scene 
change itself may appear to the motion vector estimator as a large 
amount of rapid image motion, leading to the generation of spurious and 
potentially large motion vectors. This will result in errors in the 
calculation of the respective positions of the portion 60 and the 
portion 62. Furthermore, whatever the positions of the portions 60 and 
62 are calculated to be, the actual image content of the portion 60 may 
be completely unrelated to that of the portion 62, so an interpolation 
between the portion 60 and the portion 62 will be meaningless. 

Two different analyzers for use with the apparatus of Figure 1 
and which are capable of detecting a possible scene change in the input 
video signal will now be described with reference to Figures 4 and 5. 
Suitable modifications to the apparatus shown in Figure 1 ? so that the 
output image is derived by intra- frame processing (rather than inter- 
frame processing) when a possible scene change is detected will then be 
described with reference to Figures 6 to 10. 

Figure 4 is a schematic diagram of an analyzer 70 for detecting 
a scene change between adjacent input frames of the input video signal. 
The analyzer 70 performs a predetermined test for each set of motion 
vectors to obtain a respective test result indicative of the degree of 
correlation between the pair of input images used to derive that set of 
motion vectors and detects a change of at least a predetermined size in 
the test results obtained for successive sets of motion vectors, 
thereby indicating a possible scene change in the input video signal. 
The predetermined test performed by the analyzer of Figure k is 
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to analyse the confidence fla S s generated by the motion vector 
estxmator 2k and associated with each of the motion vectors in a set of 
notion vectors. These motion vector confidence flags are received on 
an xnput 7 2 and are passed to a vector pass rate calculator 7 4 The 
vector pass rate calculator 7* calculates the number of motion vectors 
in the set of motion vectors which passed the confidence test, as a 
proportion of the total number of motion vectors in that set A test 
result calculated by the vector pass rate calculator 7 k is supplied to 
a deference calculator 78 and to a latch/delay unit 76 where the test 
result is temporarily 'stored. 

The difference calculator 78 receives the test result calculated 
by the vector pass rate calculator 7 <f corresponding to the set of 
motion vector confidence flags currently at the i nput ?2 of the 
analyzer 70. along with the test result stored in the latch/delay unit 
76 corresponding to the previous set of motion vector confidence flags 
supplied to the analyzer 7 0. The difference calculator 78 calculates 
the numerical difference between the test result received from the 
vector pass rate calculator 7 1 and the previous test result received 
from the latch/delay unit 76. passing a difference value to a 
comparator 80. 

The comparator 80 compares the difference value supplied to it by 
the difference calculator 78 with a threshold value stored in a 
threshold register 82. If the comparator 80 detects a drop in the test 
results (the proportion of motion vectors in a set which passed the 
confidence test) corresponding to two successive sets of motion 
vectors, it supplies an output 84 indicating that there has been a 
possible scene change in the input video signal. 

The output BH indicates a possible, rather than a definite, scene 
change for the following reasons. If a scene change occurred in which 
there was a high degree of correlation between the input images before 
and after the scene change, enabling successive sets of motion vectors 
to be generated for which a large proportion passed the confidence 
test, then it is likely that the interpolator 38 would continue to 
operate satisfactorily in spite of the scene change. In this case the 
output 84 would not indicate a possible scene change, but this failure 
to detect the scene change would not have a detrimental effect on the 
operation of the interpolator 38. Conversely, if a scene change did 
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not actually occur but the nature of the input video signal was such 
that the test result calculated by the vector pass rate calculator 74 
(reflecting the degree of correlation between the pair of input image 
used to generate a set of motion vectors) dropped by more than the 
threshold value between successive sets of motion vectors, then it is 
likely that the operation of the interpolator 38 would be detrimentally 
affected even though, strictly speaking, there had not been a scene 
change in the, input video signal. Such an occurrence would be 
indicated as a possible scene change on the output 84 and appropriate 
action could be taken. 

It may be necessary to apply a delay to the output 84 from the 
analyzer, in order that the output indicating whether or not a possible 
scene change has been detected between two input frames is relevant to 
the pair of input frames currently being supplied to the interpolator 
from the system delay compensator. 

The threshold value stored in the threshold register 82 may be 
changed, automatically or by an operator, using an input 86 to the 
analyzer 70. Such changes may be made necessary by the nature of a 
particular input video signal, in order to tune the detection of 
possible scene changes performed by the analyzer to that input video 
signal. 

Figure 5 is a schematic illustration of a second embodiment of an 
analyzer 90 which operates in a similar manner to the analyzer 70 
described above to produce an output 84 indicating a possible scene 
change in an input video signal. The analyzer 90 receives a set of 
inputs . 92 representing the frequencies of occurrence of the three 
global motion vectors selected by the motion vector reducer 26. For 
each set of motion vectors a summation unit 94 sums the global vector 
occurrence frequencies received on the inputs 92, passing this sum as 
a test result to a difference calculator 78 and to a latch/delay unit 
76, both of which are similar to those described above with reference 
to Figure 4. 

The difference calculator calculates the numerical difference 
between the test result received from the summation unit 94 
representing the sum of the global vector occurrence frequencies for a 
current set of motion vectors and a previous test result received from 
the latch/delay unit 76 representing that sum for the immediately 
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difference value to a comparator 80 in which the difference J 
compared with a threshold value stored ^ & » 

a drop of more than the threshold is detected in t-J\ . 
corresponding to two successive sets of ! oti ""^ 
of .ho o -i ™ motion vectors, the output 84 

ofthe answer 90 indicates . possIble scene eh 

input 86 to the threshold register 82. 

A combination strategy for detecting possible scene changes could 

analyzer 70 or the analyzer 90. 

A .odzfied interpoletor 99 is shown, which receives a pair of 
znput fra.es fro. the syste. delay co-pensator at the sa»e ti.e as it 

1 il t f r " " V6Ct0rS ^ S " «*• 

two input fra.es currently being supplied to the interpolator 99 and 

s stored in a .otion vector store 100. The interpolator 9, all 
recezves control information fro. the time base changer (suitably 
delayed by the syste. delay ccpensator 30, indicative 
posztzon of the retired output field with respect to the pair of input 

For normal operation (ie when a possible scene change has not 
been zndzcated by the analyzer, two switches 10! and 104 in I 
znterpolator are set to "noroal" positions 106 and 108 respectively 
An znterpolatzon unit 109 interpoletes the output field as described 
above with reference to Figure 3. in that each pixel 5 6 in the ou 
fzeld 50 zs derzved fro. a portion 60 of the precede input fraee 53 
and a portzon 62 of the following input fraM 5 „, the * 

Z tiT 1 « tel " S dePe " dent UPO " ~"» » correspond „: 

to the pzxel 5 6 and upon the teaporal position of the output field 50 

The interpolator also receives an input 110 free the analyzer on 
whzch a possible scene change can be indicated. When a possible scene 
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change is indicated the switches 102 and 10*1 are set to "scene change" 
positions 112 and 114 respectively. This has two effects on the 
operation of the interpolator 99: one effect is that the interpolation 
unit 109 uses a set of zero motion vectors stored in a zero motion 
vector store 116 instead of the set stored in the motion vector store 
100 f and another effect is that the output field position is 
substituted by a value calculated by a single nearest frame calculator 
118. 

As far as the interpolation unit 109 is concerned, when a 
possible scene change is indicated on the input 110 the interpolation 
operation proceeds as normal to produce a field of the output video 
signal. However, this operation is carried out using a set of motion 
vectors from the zero motion vector store 116, all of which are the 
zero motion vector, and also using a substituted output field position 
calculated by the single nearest frame calculator 118 which specifies 
to the interpolation unit 109 that the output field is temporally 
coincident with the nearer of the preceding input frame and the 
following input frame. 

Figures 7 and 8 show the operation of the modified interpolator 
shown in Figure 6 when a possible scene change is detected by the 
analyzer (70 or 90) and indicated to the interpolator on the input 110. 
Figure 7 shows the situation when the temporal position of the output 
field 50 is closer to that of the preceding input frame 52 than it is 
to that of the following input frame 5**. Conversely, Figure 8 shows 
the situation when the temporal position of the output field 50 is 
closer to that of the following input frame 5** than to the position of 
the preceding input frame 52. 

When a possible scene change is indicated on the input 110 to the 
interpolator 99 in Figure 6, the switch 102 selects the "scene change" 
position 112, causing a set of zero motion vectors to be used. This is 
illustrated in Figures 7 and 8 in which a zero motion vector 120 is 
used for derivation of the output field 50 • Also, when a possible 
scene change is indicated on the input 110 to the interpolator 99 in 
Figure 6, the switch 104 selects the "scene change" position 114. The 
effect of this, as mentioned above, is that instead of receiving a 
signal indicative of the temporal position of the output field with 
respect to the preceding input frame 5 2 and the following input frame 
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54, the interpolation unit 109 receives a signal indicating that the 
output field 50 is temporally coincident with the nearer of the 
preceding input frame 52 and the following input frame 54. This has 
the effect that an apparently normal interpolation process can be 
performed, but the output field produced by the interpolation unit is 
dependent entirely on the nearer input frame specified by the single 
nearest frame calculator 118 and not dependent at all on the other of 
the two input frames. 

In Figure 7 the output field 50 is closer to the preceding input 
frame 52 than to the following input frame 5^, so each pixel 56 in the 
output field 50 is dependent only upon a portion 60 of the preceding 
input frame. The position of the portion 60 in the preceding input 
frame 52 corresponds to the position of the pixel 56 in the output 
field 50 because a zero motion vector 120 is used. Similarly, in 
Figure 8 the output field 50 is temporally closer to the following 
input frame 54 than to the preceding input frame 52, so each pixel 56 
in the output field is dependent only upon a portion 62 in the 
following input frame 54. Again, the portion 62 is at a position in 
the following input frame 54 corresponding to the position of the pixel 
56 in the output field 50 because a zero motion vector 120 is used. 

Figures 9 and 10 are schematic diagrams illustrating a second way 
in which the apparatus shown in Figure 1 can be modified so as to 
change the way in which output fields are derived when a possible scene 
change is detected by the analyzer (70 or 90). 

In Figure 9 the pair of input frames selected by the time base 
changer 14 for use in the derivation of an output field are suitably 
delayed by the system delay compensator 30 and are routed to the 
interpolator 38 and to two respective frame stores t namely a preceding 
frame store 122 and a following frame store 124. A switch 126 selects 
between the outputs of the interpolator 38, the preceding frame store 
122 and the following frame store 124, under the control of a control 
signal 128. The control signal 128 is calculated by a single nearest 
frame calculator 130 which is responsive to an input from the analyzer 
indicating whether a possible scene change in the input video signal 
has been detected, and to an input indicative of the temporal position 
of the current output field with respect to the pair of input frames. 
When a possible scene change is not indicated the control signal 128 
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controls the switch 126 to select the output of the interpolator 38. 
When a possible scene change is indicated, the single nearest frame 
calculator determines whether the preceding input frame or the 
following input frame is closer to the temporal position of the 
required output field and causes the switch 126 to select the output of 
the preceding frame store 122 or the following frame store 124 as 
appropriate. Depending on whether the current output field is an odd 
or an even output field, the contents of the selected frame store are 
subsampled (with or without a filtering process) so that only the odd 
or the even lines in the selected frame store are used to form the 
» output field. 

A simpler embodiment is shown in Figure 10. in which a single 
frame store 130 stores a predetermined one of the input frames. A 
switch 132 selects between the output of the frame store and the output 
of the interpolator 38. in response to a control signal indicating 
whether a possible scene change has been detected by the analyzer 70. 
In operation, the switch 132 simply selects the output of the 
interpolator 38 when a possible scene change has not been detected and 
selects the output of the frame store 130 when a possible scene change 
has been detected. As before, the output field is a subsampled version 
of the contents of the frame store 130. 

The apparatus shown in Figures 9 and 10 may be used in situations 
such as video to film conversion when the required interpolated output 
images are video frames rather than interlaced video fields, by . 
supplying all of the lines of image data in the appropriate frame store 
122, 124 or 130 as an output image. 

Although the embodiments of the invention described above have 
related to television standards conversion, the techniques used are 
equally applicable to other forms of motion compensated video signal 
processing. For example, in a film-to-film standards conversion 
apparatus, an input telecine apparatus would be connected as an input 
to, effectively, a television standards conversion apparatus which 
would then be connected to an output electron beam recorder for re- 
recording the video information on to film. All of the interpolation 
processes described above are suitable to be used to produce field- or 
frame-based output video signals. 
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Claims 

l. 



V 1(Ie o signal processing apparatus for interpolating ontput images 
of an output video signal fro* corresponding pairs of tesporilv 
accent input ioages of an input video signal, the video signal 
processing apparatus comprising: 

a action vector generator for generating sets of ootion vectors 
representing motion between respective pairs of temporally adjacent 
input images; 

an analyzer for performing a predetermined test for each set of 
motion vectors to obtain a respective test result indicative of the 
degree of correlation between the pair of temporally adjacent input 
-ages from „hich that set of motion vectors was generated and for 
detecting a change of at least a predetermined size in the test results 
obtained for successive sets of motion vectors, thereby indicating a 
possxble scene change in the input video signal; and 

a motion compensated interpolator for interpolating an output 
xmage from a corresponding pair of temporally adjacent input images 
us.ng the sets of motion vectors generated from that pair of input 
xmages when a possible scene change is not indicated, and for 
generating an output image by intra-image processing of one of the 
corresponding pair of input images when a possible scene change is 
indicated. e 

25 2. Video signal processing apparatus according to claim 1. in which 

the motion compensated interpolator comprises: 

means for receiving a control signal indicative of the temporal 
position of an output image to be interpolated with respect to the 
temporal positions of the corresponding pair of temporally adjacent 
input images; 

means responsive to the control signal for setting the relative 
Proportions of the corresponding pair of input images to be used in 
interpolation of the output image in dependence on the temporal 
position of the output image when a possible scene change is not 
50 indicated; 

means for setting the relative proportions of the corresponding 
pair of input images to be used in interpolation of the output image so 
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that the output image depends on the content of a selected one of the 
pair of input images when a possible scene change is indicated; and 

interpolation means for generating the output image by combining 
the corresponding pair of input images according to the relative 
proportions . 

3. Video signal processing apparatus according to claim 2, in which 
the selected one of the pair of input images is that input image which 
is temporally closest to the output image. 

4. Video signal processing apparatus according to claim 2 or claim 
3. in which the motion compensated interpolator comprises means for 
setting the set of motion vectors to be used in interpolation to a set 
of zero motion vectors when a possible scene change is indicated. 

5. Video signal processing apparatus according to claim 1, 
comprising: 

an image store for storing at least one of the corresponding pair 
of input images from which an output image is to be interpolated; and 

means responsive to the analyzer indicating a possible scene 
change for setting the output image to be equal to at least a portion 
of a stored input image. 

6. Video signal processing apparatus according to any one of the 
preceding claims, in which: 

the motion vector generator comprises means for performing a 
predetermined confidence test on each motion vector in a set of motion 
vectors ; and 

the analyzer comprises means for generating a test result 
dependent upon the proportion of the motion vectors, in a set of motion 
vectors, which passed the confidence test. 

7. Video signal processing apparatus according to any one of the 
claims 1 to 5, in which: 

the motion vector generator comprises means for detecting a 
predetermined number of most commonly occurring motion vectors in a set 
of motion vectors; and 
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the analyzer comprises means for generating a test result 
dependent upon the sum of the frequencies of occurrence of the 
predetermined number of most commonly occurring motion vectors. 

5 8. Video signal processing apparatus according to any one of the 

preceding claims, in which the input images are successive video frames 
of the input video signal, 

v 

9. Video signal processing apparatus according to claim 8 t 
10 comprising: 

means for receiving an interlaced video signal; and 

a progressive scan converter for converting pairs of temporally 

adjacent video fields in the interlaced video signal into respective 

video frames of the input video signal. 

15 

10. A television standards converter comprising image processing 
apparatus according to any one of the preceding claims. 

11. A method of interpolating output images of an output video signal 
20 from corresponding pairs of temporally adjacent input images of an 

input video signal, the method comprising the steps of: 

generating sets of motion vectors representing motion between 
respective pairs of temporally adjacent input images; 

performing a predetermined test for each set of motion vectors to 
25 obtain a respective test result indicative of the degree of correlation 

between the pair of temporally adjacent input images from which that 
set of motion vectors was generated; 

detecting a change of at least a predetermined size in the test 
results obtained for successive sets of motion vectors, thereby 
30 indicating a possible scene change in the input video signal; and 

interpolating an output image from a corresponding pair of 
temporally adjacent input images using the sets of motion vectors 
generated from that pair of input images when a possible scene change 
is not indicated, and generating an output image by intra-image 
35 processing of one of the corresponding pair of input images when a 

possible scene change is indicated. 
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12. Video signal processing apparatus substantially as hereinbefore 
described with reference to Figures 3 to 10. 



13. A method of image processing substantially as hereinbefore 
5 described with reference to Figures 3 to 10. 

14. A television standards converter substantially as hereinbefore 
described with reference to Figures 3 to 10. 
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